WORLD INTELLECTUAL PROPERTY ORGANIZATION. 
International Bureau 




PCX 

INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification ^ : 
G06F 17/30, 17/60 



Al 



(11) International Publication Number: WO 99/46701 

(43) International Publication Date: 16 September 1999 (16.09.99) 



(21) International Application Number: PCT/US99/04489 

(22) Internationa! Filing Date: 1 March 1999 (0K03.99) 



(30) Priority Data: 

60/077.322 
60/077,655 
09/066,523 
09/066,739 



9 March 1998 (09.03.98) US 

11 March 1998 (11.03.98) US 

20 March 1998 (20.03.98) US 

20 March 1998 (20.03.98) US 



(63) Related by Continuation (CON) or Continuation-in-Part 
(CIP) to Earlier Applications 

US 

Filed on 
US 

Filed on 
US 

Filed on 
US 

Filed on 



60/077,322 (CON) 
9 March 1998 (09.03.98) 
60/077,655 (CON) 
11 March 1998 (11.03.98) 
09/066,523 (CON) 
20 March 1998 (20.03.98) 
09/066,739 (CON) 
20 March 1998 (20.03.98) 



(71) Applicant (for all designated States except US): AMA- 
ZON.COM, INC. [US/US]; Suite 3600, 900 Fourth 
Avenue, Seattle, WA 98164 (US). 



(72) Inventors; and 

(75) Inventors/Applicants (for US only): GUPTA, Ashish [IN/US]; 
482 Cuesta Drive, Los Altos, CA 94024 (US). RAJARA- 
MAN, Anand [IN/US]; Apartment 39, ill N. Rengstorff 
Avenue, Mountain View, CA 94043 (US). 

(74) Agents: DURDIK, Paul, A. et al.; Townsend and Townsend 
and Crew LLP, 8th floor, Two Embarcadero Center, San 
Francisco, CA 941 1 1-3834 (US). 



(81) Designated States: AL. AM, AT, AU, AZ, BA, BB, BG, BR, 
BY, CA, CH, CN, CU, CZ, DE, DK, EE, ES. FI, GB, GD, 
GE, GH, GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, 
KR, KZ, LC, LK, LR, LS, LT, LU, LV, MD, MG, MK, 
MN, MW, MX, NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, 
SK, SL, TJ, TM, TR, TT, UA, UG, US, UZ, VN. YU, ZW, 
ARIPO patent (GH, GM, KE, LS, MW, SD, SL, SZ. UG. 
ZW), Eurasian patent (AM, AZ, BY. KG, KZ, MD. RU, TJ, 
TM), European patent (AT. BE, CH, CY, DE, DK, ES, FI, 
FR, GB, GR, IE, IT. LU, MC, NL. PT, SE), OAPI patent 
(BF, BJ, CF, CG, CI, CM. GA, GN. GW, ML, MR, NE, 
SN, TD, TG). 



Published 

With international search report. 



(54) Title: METHOD AND SYSTEM FOR AUTOMATICALLY FILLING FORMS 
TRANSACTION ENVIRONMENT 

(57) Abstract 

A method of automatically filling in on-line forms presented 
by web pages in an internet transactional environment by deter- 
mining (350) based upon selectable criteria a form identifier cor- 
responding to a particular on-line form, and thereupon, for each 
form so identified, indentifying (352) one or many corresponding 
match patterns (354) with which a page containing a target on-line 
fomi is parsed (358) to obtain a plurality of attributes, and there- 
upon, for each attribute obtained in the parsing step, indexing into 
a database to obtain (360) and then appropriately transform (362) 
user information which may be used to fill in (364) the target form. 



IN AN INTEGRATED NETWORK BASED 



wdUpon <^ 

ApproprtatoOf^ 350 

fty a Parllaiv V«ndar 
Uilnq RatiBorohlpSO 



ocq RaUboraNp 60 ttw 
RaqukvdtoFBIinFonn 



n 

360 



Obtain VAMkrEMtt 
PfOp#rt|f Uiino 



362 



Tranatom 




n 

364 



Modify Pago bFnbt A 
U«»rVakiMlcwEaah 



BAMd Upon th* Fonn 



352 







UstchOM 
9» 


PsSamalo 



354 




FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCX on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN 


Senegal 


AU 


Australia 


CA 


Gabon 


LV 


Latvia 


sz 


Swaziland 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


DE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turlcmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mexico 


uz 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyrstan 


NO 


Norway 


ZW 


Zimbabwe 


CI 


C6ce d' [voire 


KP 


Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


PT 


Portugal 






cu 


Cuba 


KZ 


Kazakstan 


RO 


Romania 






cz 


Czech Republic 


LC 


Saint Lucia 


RLt 


Russian Federation 






DE 


Germany 


U 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







wo 99/46701 



1 



PCTAJS99/04489 



METHOD AND SYSTEM FOR AUTOMATICALLY FILLING FORMS 
IN AN INTEGRATED NETWORK BASED TRANSACTION 

ENVIRONMENT 

COPYRIGHT NOTICE 
A portion of the disclosure of this patent document contains material which 
is subject to copyright protection. The copyright owner has no objection to the facsimile 
reproduction by anyone of the patent document or the patent disclosure as it appears in 
the Patent and Trademark Office patent file or records, but otherwise reserves all 
copyright rights whatsoever. 

CROSS-REFERENCE TO RELATED APPLICATIONS 
This application claims priority from the following U.S. Provisional 
Applications, the disclosure of which, including all appendices and all attached 
documents, is incorporated by reference in its entirety for all purposes: 

U.S. Provisional Patent Application Serial No. , Anand 

Rajaraman, et, al. entitled, "Method and System for Integrating Transaction Mechanisms 
Over Multiple Internet Sites," filed March 9, 1998, (attorney docket number 17907- 
15.0); and 

U.S. Provisional Patent Application Serial No. , Anand 

Rajaraman, et. al. entitled, "Automatically Filling Forms," filed March 11, 1998, 
(attorney docket number 17907-16.0). 

The following two commonly-owned copending applications, including this 
one, are being filed concurrently and the other one is hereby incorporated by reference in 
its entirety for all purposes: 

U.S. Patent Application Serial No. , Ashish Gupta, et. al. 

entitled, "Method for Integrating Transaction Mechanisms Over Multiple Internet Sites" 
(attorney docket number 17907-15.10); and 
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U.S. Patent Application Serial No. , Ashish Gupta, et. al. 

entitled. "Method for Automatically Filing Forms in an Integrated Network Based 
Transaction Environment," (attorney docket number 17907-16.10). 

This application makes reference to the following commonly owned U.S. 
Patent Applications, which are incorporated herein in their entirety for all purposes: 

Copending U.S. Patent Application Serial No. 08/724,943, in the name of 
Ashish Gupta, et. aL, entitled "Method and Apparatus for Structuring the Querying and 
Interpretation of Semistructured Information," relates to information retrieval and 
interpretation from disparate semistructured information resources; and 

Copending U.S. Patent Application No. 08/995,868, in the name of Ashish 
Gupta, et. al., entitled "Method for Data Gathering Around Forms and Search Barriers," 
which relates to submitting forms to gather data. 

BACKGROUND OF THE INVENTION 
This invention relates to the area of internet based commerce. 
Specifically, this invention enables a method and system for automatically filling in and 
submitting forms presented by vendor sites in order to effect commercial transactions on 
the web. 

The process of interacting with the web through a browser may be broadly 
conceptualized as two types of interactions. The first kind of interaction is based on a 
user finding information and collating it without subsequent interaction with the provider 
of the information. This is similar to reading a magazine or researching a library. The 
second kind of interaction is based upon a user requesting goods or services from the 
provider of the information on the web. Electronic commerce is based upon the 
confluence of both these activities. 

From a user's perspective, the web is useful largely because of the ease at 
which it makes information available and the diversity of information it provides. 
Problems arise when the information is scattered in many places and not readily 
accessible or not easily searchable. The following issues impede the efficient use of data 
by users of the world wide web: (a) different data representations, (b) different 
vocabularies, (c) different levels of functionality (d) multiple locations, and (e) absence 
from the web. 



wo 99/46701 PCT/US99/04489 

3 

In a co-owned, co-pending U.S. Patent Application Serial No. 08/724,923, 
entitled "Method and Apparatus for Structuring the Querying and Inteq)retation of 
Semistructured Information," Ashish Gupta, et. al. introduced Virtual Database 
Management System ("VDBMS") technology in which structure is added to semi- 
structured data, thereby making the data searchable using known techniques. Further, 
VDBMS technology enables data from multiple sites to be integrated together and made 
searchable via a common mechanism. This technology is applicable to non-web sources 
such as legacy data sources in Relational Database Management Systems ("RDBMS"), 
text files, feeds in systems like SII. word and other text processor documents, UNIX file 
systems, and so forth. The technology's broad applicability in integrating a multiplicity 
of sources has been proven in the market in publicly available services. 

The flow of information from the user to providers of data is as important 
as the flow of information from providers to the user. The bidirectional exchange of 
data forms the basis of commerce in traditional media and online. For example, a 
purchase involves information flow from the store to the buyer, in the display of goods 
available, and from the buyer to the store, in that information is a credit card number or 
a check or cash to complete the transaction. 

Currently, internet purchasers must visit multiple web sites in order to 
consununate a transaction. For example, a user desiring to purchase a book entitled 
"World Peace," and a CD-ROM entitled "Unplugged", desires to make these purchases 
efficiently and to get the best prices for these items. The user must visit many different 
vendors to determine who sells the items, select a particular vendor for each item based 
on separately visiting the vendors, fill in multiple forms for the different vendors, each 
of which requires the user to enter the same information and finally track multiple 
transactions. 

Using the search methods described in U.S. Patent Application No. 
08/724,923, the user can find the best price for any item available from many vendors. 
The user is able to seamlessly query multiple different vendor data to make a decision, 
sunplifying the decision process. However, purchasing the items still requires that the 
user interact with multiple web site "shopping carts," and fill in the required information 
multiple times. For example, the user must give her name, address, credit card number 
and click the "Buy it" button for each of the vendors and deal with their order entry 
forms. 
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What is needed is a method to enable a user shopping for items from 
different vendors* Web sites to automatically fill in order forms and then to purchase 
these items without having to browse and interact with different sites. 

SUMMARY OF THE INVENTION 
According to the invention, a method of automatically filling in on-line 
forms presented by web pages in an internet transactional environment by determining 
based upon selectable criteria a form identifier corresponding to a particular on-line 
form, and thereupon, for each form so identified, identifying one or many corresponding 
match patterns with which a page containing a target on-line form is parsed to obtain a 
plurality of attributes, and thereupon, for each attribute obtained in the parsing step, 
indexing into a database to obtain user information which may be used to fill in the target 
form. 

The above approach has many advantages: 

A key advantage of systems according to the present invention is that the 
user does not have to fill in multiple forms in order to effect internet transactions. 

A further advantage of the present invention is that the user does not have 
to interact with multiple dissimilar interfaces. 

A yet further advantage of the present invention is that the user can shop 
across multiple vendors without repeatedly entering purchase information. 

The invention will be better understood with reference to the following 
detailed description and its accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. lA depicts a representative client server relationship in accordance 
with a particular embodiment of the invention; 

Fig. IB depicts a functional perspective of the representative client server 
relationship in accordance with a particular embodiment of the invention; 

Fig. IC depicts a functional perspective of the components of a particular 
embodiment of the invention; 

Fig. ID depicts a plurality of relationships among data in accordance with 
a particular embodiment of the invention; 
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Figs. 2 A - 2D depict representative forms in accordance with a particular 
embodiment of the invention; 

Figs. 3 A - 3D depict flowcharts of processing in accordance with a 
particular embodiment of the invention. 

DESCRIPTION OF THE SPECIFIC EMBODIMENTS 
1.0 Introduction 

The present invention provides a method for automatically filling in 
information into forms presented by vendor web sites in order to effect commercial 
transactions on the web. Systems according to the present invention enable online 
shoppers to make selections and purchase products from a plurality of vendor sources 
using a common interface program without requiring the user to repeatedly fill in 
redundant information into purchasing forms presented by vendor web sites. A particular 
embodiment according to the invention has been reduced to practice and will be made 
available under the trade name "AutoScribe."™ Table I provides a definitional list of 
certain terms used herein: 

Attribute A blank space in a form, used to hold information, such as mailing 

address. 

Property A piece of user meta data. 

Transformation A function which when applied to user meta data yields a value to 
Function fill into a form. 

Table 1 

1.1 Hardware Overview 

The method for automating form filling in order to effect conmiercial 
transactions on the web is implemented in the Perl and Java programming languages and 
is operational on a computer system such as shown in Fig. lA. This invention may be 
implemented in a client-server environment, but a client-server environment is not 
essential. Fig. lA shows a conventional client-server computer system which includes a 
server 20 and numerous clients, one of which is shown as client 25. The use of the term 
"server" is used in the context of the invention, wherein the server receives queries from 
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(typically remote) clients, does substantially all the processing necessary to formulate 
responses to the queries, and provides these responses to the clients. However, server 
20 may itself act in the capacity of a client when it accesses remote databases located at 
another node acting as a database server. 

The hardware configurations are in general standard and will be described 
only briefly. In accordance with known practice, server 20 includes one or more 
processors 30 which communicate with a number of peripheral devices via a bus 
subsystem 32. These peripheral devices typically include a storage subsystem 35, 
comprised of memory subsystem 35a and file storage subsystem 35b, which hold 
computer programs (e.g., code or instructions) and data, set of user interface input and 
output devices 37, and an interface to outside networks, which may employ Ethernet, 
Token Ring, ATM, IEEE 802.3, ITU X.25, Serial Link Internet Protocol (SLIP) or the 
public switched telephone network. This interface is shown schematically as a "Network 
Interface" block 40. It is coupled to corresponding interface devices in client computers 
via a network connection 45. 

Client 25 has the same general configuration, although typically with less 
storage and processing capability. Thus, while the client computer could be a terminal 
or a low-end personal computer, the server computer is generally a high-end workstation 
or mainframe, such as a SUN SPARC™ server. Corresponding elements and subsystems 
in the client computer are shown with corresponding, but primed, reference numerals. 

The user interface input devices typically includes a keyboard and may 
further include a pointing device and a scanner. The pointing device may be an indirect 
pointing device such as a mouse, trackball, touchpad, or graphics tablet, or a direct 
pointing device such as a touchscreen incorporated into the display. Other types of user 
interface input devices, such as voice recognition systems, are also possible. 

The user interface output devices typically include a printer and a display 
subsystem, which includes a display controller and a display device coupled to the 
controller. The display device may be a cathode ray tube (CRT), a flat-panel device 
such as a liquid crystal display (LCD), or a projection device. Display controller 
provides control signals to the display device and normally includes a display memory 
for storing the pixels that appear on the display device. The display subsystem may also 
provide non-visual display such as audio output. 
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The memory subsystem typically includes a number of memories including 
a main random access memory (RAM) for storage of instructions and data during 
program execution and a read only memory (ROM) in which fixed instructions are 
stored. In the case of Macintosh-compatible personal computers the ROM would include 
portions of the operating system; in the case of IBM-compatible personal computers, this 
would include the BIOS (basic input/output system). 

The file storage subsystem provides persistent (non-volatile) storage for 
program and data files, and typically includes at least one hard disk drive and at least 
one floppy disk drive (with associated removable media). There may also be other 
devices such as a CD-ROM drive and optical drives (all with their associate removable 
media). Additionally, the computer system may include drives of the type with 
removable media cartridges. The removable media cartridges may. for example be hard 
disk cartridges, such as those marketed by Syquest and others, and flexible disk 
cartridges, such as those marketed by Iomega. One or more of the drives may be 
located at a remote location, such as in a server on a local area network or at a site of 
the Internet's World Wide Web. 

In this context, the term "bus subsystem" is used generically so as to 
include any mechanism for letting the various components and subsystems communicate 
with each other as intended. With the exception of the input devices and the display, the 
other components need not be at the same physical location. Thus, for example, portions 
of the file storage system could be connected via various local-area or wide-area network 
media, including telephone lines. Similarly, the input devices and display need not be at 
the same location as the processor, although it is anticipated that the present invention 
will most often be implemented in the context of PCs and workstations. 

Bus subsystem 32 is shown schematically as a single bus, but a typical 
system has a number of buses such as a local bus and one or more expansion buses (e.g., 
ADB, SCSI, ISA, EISA. MCA, NuBus, or PCI), as well as serial and parallel ports. 
Network connections are usually established through a device such as a network adapter 
on one of these expansion buses or a modem on a serial port. The client computer may 
be a desktop system or a portable system. 

The user interacts with the system using interface devices 37' (or devices 
37 in a standalone system). For example, client queries are entered via a keyboard, 
communicated to client processor 30', and thence to network interface 40' over bus 
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subsystem 32'. The query is then communicated to server 20 via network connection 45. 
Similarly, results of the query are communicated from the server to the client via 
network connection 45 for output on one of devices 37' (say a display or a printer), or 
may be stored on storage subsystem 35'. 

1.2 Software Architecture 

Fig. IB is a functional diagram of the computer system of Fig. 1 A. Fig. 
IB depicts a server 20, and a representative client 25 of a multiplicity of clients which 
may interact with the server 20 via the internet 45 or any other communications method. 
Blocks to the right of the server are indicative of the processing components and 
functions which occur in the server's program and data storage indicated by block 35a in 
Fig. lA. A TCP/IP "stack" 44 works in conjunction with Operating System 42 to 
communicate with processes over a network or serial connection attaching Server 20 to 
internet 45. Web server software 46 executes concurrently and cooperatively with other 
processes in server 20 to make data objects 50 and 51 available to requesting clients. A 
Common Gateway Interface (CGI) script 55 enables information from user clients to be 
acted upon by web server 46, or other processes within server 20. Responses to client 
queries may be returned to the clients in the form of a Hypertext Markup Language 
(HTML) document outputs which are then communicated via internet 45 back to the 
user. 

Client 25 in Fig. IB possesses software implementing functional processes 
operatively disposed in its program and data storage as indicated by block 35a' in Fig. 
lA. TCP/IP stack 44', works in conjunction with Operating System 42' to communicate 
with processes over a network or serial connection attaching Client 25 to internet 45. 
Software implementing the function of a web browser 46' executes concurrently and 
cooperatively with other processes in client 25 to make requests of server 20 for data 
objects 50 and 51. The user of the client may interact via the web browser 46' to make 
such queries of the server 20 via internet 45 and to view responses from the server 20 
via internet 45 on the web browser 46'. 

Fig. IC depicts a functional perspective of the software components 
resident in storage subsystem 35' of client 25 or storage subsystem 35 server 20, which 
cooperatively perform automated transaction processing in accordance with a particular 
embodiment of the invention. Transaction integrator 100 performs processing of 
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information in conjunction with one or more wrapper programs 140, 150 and 160 
configured to specific merchandising sites 139, 149 and 159. Automated form filling 
component 110 interacts with User Meta-database 170 and User Selection database 180 in 
order to perform the filling in of online forms presented by various shopping sites. 
Transaction integrator 100 controls responding to the user's requests to search for 
various merchandise, obtaining information from the user about the user's merchandise 
selections from, the search results and building information into the User Meta-database 
170 and the User Selection database 180. 

Fig. ID depicts a plurality of relationships between data objects in the 
User Meta-database 170. Relationship 60 associates a form finding criterion, here a 
form URL 64, with a form identifier, here a form name 62. Relationship 70 associates a 
pattern for matching 74 with a form name 72. Relationship 80 associates a form name 
82 with a property name 86, an attribute name 84 and a transform function 88, Attribute 
84 is a field in a form which we would like to fill in automatically, for example a space 
for the user's name. Property 86 is a piece of user meta data, stored in User Meta- 
database 170, for example, a name of a user. Transformation function 88 converts a 
property into a value for filling in a field in a form. For example, consider a form that 
has an attribute called "name" which is of a type "last name, first name." Further, 
consider user meta data that unique to each user comprising a first property, 
"first-name," and a second property, "last-name." A value to fill into the form for the 
"name" attribute is obtained by concatenating the property "last-name," followed by a 
"comma," followed by the property "first-name." The concatenation process is a 
transformation function. Using this technique, the same user meta data may be specified 
in different ways by different forms. Applying these techniques, provides the ability to 
specify how to modify properties, or meta data, to fill in a wide variety of forms. 
Finally, relationship 90 associates a User ID 92 with a form ID 94, and a plurality of 
property- value tuples 96, 98 and 99. 

2.0 On-line Transactions Forms 

Figs. 2 A and 2B depict representative forms for transactions with online 
merchants. The usual method of consummating a purchase order is for the user to fill in 
the fields in a series of forms with the required information and click a "submit" button 
to complete the purchase. Fig. 2A depicts a registration form 201, having a plurality of 



wo 99/46701 PCT/US99/04489 

10 

fields in which the user enters information. The user must enter her name in a name 
field 202, her mailing mformation in address fields 204, 206, 208, 210 and 212, her 
telephone number in a telephone number field 214, then click a "done" button 216 to 
submit form 201 to the server 20. Fig. 2B depicts a shipping and account information 
5 form 203, having a plurality of fields in which the user must enter information. The 
user enters her desired method of shipment by selecting the corresponding button in 
shipment box 220. Next, she indicates the type of account she wishes to establish using 
buttons 222 and 224. Then, she enters her payment information in credit card type 
button 226, card number field 228, expiration field 230, name field 232 and issuing bank 
10 field 234. Thus, it is not one form that is filled in, but a series of forms. 

3.0 Automating On-line Transactions 

3.1 Automating A Single On-line Transaction 

Fig. 3 A depicts a flowchart 301 of the process steps in executing an 
15 automated transaction. In a step 312, the user performs a search for items of interest 
using a search program as is known in the art. Then, in a step 314, a result page 
depicting the results of the search performed in step 312, such as result page 205 of Fig. 
2C, is displayed to the user. Next, in a step 316, the user makes a selection of an item 
from the result page using a mouse, or other method. Next, in a step 318, a transaction 
20 is initiated with a site corresponding to a vendor offering the merchandise selected by the 
user. For example, in the sample result page 205, when a user clicks a "Buy it" link 
240, a request to buy the selected product is initiated at the site of the vendor 
corresponding to the item selected by the user. Processing for this step is depicted in 
greater detail in a flowchart 305 in Fig, 3C. 

25 

3.2 Transactions with Multiple On-line Vendors 

Multiple purchases across different vendors are integrated based upon the 
concept of a "virtual check-out counter," from which all transactions are consummated. 
The virtual checkout counter enables the user to make payments at a single point even 
30 though returns and product question transactions are handled by individual vendor sites. 
Fig. 33 depicts a- flowchart 303 of steps in virtual check-out counter processing. In a 
step 322, the user performs a search for items of interest using a search program as is 
known in die art. Then, in a step 324, a result page depicting the results of the search 
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performed in step 322, such as result page 206 of Fig. 2D, is displayed to the user. 
Next, in a step 325, the user's selection of an item from the result page 206 by using a 
mouse to click an "Add it" icon 242, or other method, is added to a list of items to 
purchase. Then, in a step 326, the list is parsed for selection data. Next, in a step 328, 
selection data for the purchase request is stored into the User Selection database 180. 
Next, in a decisional step 330, a determination is made whether the user has finished 
making selections. If the user makes further selections, the processing depicted by steps 
322 - 330 of flowchart 303 is performed for each selection made by the user. 
Otherwise, responsive to the user's request to "check out," in a decisional step 332, a 
determination is made if any selections made by the user require transaction processing. 
In a step 334, transaction processing is performed for each selection made by the user in 
steps 322-330 of flowchart 303. Flowchart 305 of Fig. 3C depicts the transaction 
processing of step 334 in greater detail. Otherwise, when no further user selections 
remain, processing returns. 

3.3 Automating Transaction Form Filling 

Fig. 3C depicts a flowchart 305 depicting the processing for completing a 
transaction with a vendor on behalf of a user. In a decisional step 342, a determination 
is made whether there are any remaining forms which must be filled in to complete the 
transaction. If a form must be filled in, then in a step 344, the form is filled in by 
processing detailed in Fig. 3D. Next, processing returns to decisional step 342. When 
decisional step 342 determines that no further forms remain, all forms required by the 
vendor site have been filled in. Processing then continues with an optional step 346, 
which displays a screen to prompt the user to confirm the purchase. Finally, in a step 
348, the transaction with the vendor site is completed and confirmation information 
returned by the vendor is stored for subsequent tracking. 

3.4 Automated Order Form Filling 

Forms associated with a vendor's site corresponding to product selections 
made by a user are automatically filled in with the information stored in User Meta- 
database 170 and -User Selection database 180, such as the name, credit card number, 
and address of a user, using relationships 60, 70, 80 and 90 depicted in Fig. ID. Fig. 
3D depicts a flowchart 307 of the process steps for automated form filing according to a 
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particular embodiment of the invention. In a step 350, the appropriate form identifier for 
a particular vendor is determined based upon a selectable criterion using relationship 60. 
Relationship 60 associates the criterion of form URL 64 with a form identifier, form 
name 62. Next, in a step 352, the form identifier determined in step 350 is used to 
determine one or more corresponding matching patterns using relationship 70. 
Relationship 70 associates form identifier form name 72, which will be the form 
identifier determined in step 350, with pattern 74. Next, in a step 354, pattern 74 is 
matched against a page web page containing a form of interest which is to be filled in. 
In a decisional step 356, if no match is found with the pattern 74, then an error condition 
is remmed, so that a system administrator can be made aware that there is a form for 
which no matching pattern exists. Otherwise, in a step 358, die page is parsed in order 
to obtain a plurality of attributes. Then, in a step 359, properties are identified using 
relationship 80 to identify those required to fill in the target form. In a step 360, a value 
is obtained for each property using relationship 90 by matching the form identifier to a 
form name 94 and reading property - value pairs 96. 98 and 99. Next, in a step 362. the 
properties determined in step 358 are transformed using relationship 80 to yield values 
for each attribute in the target form by applying transformation function 88 
corresponding to property name 86 matching the property of interest in relationship 80 
for the particular form identifier form name 82. The result is used to fill in the attribute 
corresponding to attribute name 84. Finally, in a step 364, the target form is filled in 
with property values obtained in step 362. Then processing returns. 

3.4.1 Submitting Forms Using A Wrapper 

In an alternative embodiment, the concept of a wrapper, a program which 
fills in and submits forms in order to accumulate information from web sites, may be 
used to complete a purchase transaction. The data to be filled into each form is obtained 
from the User Meta-database 170 and User Selection database 180. Wrapper programs 
are described in detail in a co-owned, co-pending U.S. Patent Application No. 
08/724,943, in the name of Ashish Gupta, et. al.. entitled Method and Apparams for 
Structuring the Querying and Interpretation of Semistructured Information," which is 
incorporated herein by reference in its entirety for all purposes. 

According to this embodiment, a wrapper program is constructed for each 
vendor to capmre the logic for the forms that need to be filled to consummate a 
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purchase. A second wrapper program is constructed for each site to perform 
information-gathering. The transaction- wrapper exercises different parts and different 
functionality of the site than the information-gathering wrapper. Any site can have 
multiple wrappers built for it, each of which gets different information or performs a 
different function. Constructing wrappers which fill in and submit forms is described in 
greater detail in a co-owned, co-pending U.S. Patent Application No. 08/995,868, in the 
name of Ashish. Gupta, et. al., entitled "Method for Data Gathering Around Forms and 
Search Barriers," which is incorporated herein by reference in its entirety for all 
purposes. 

According to this embodiment, the user's clicking the "Buy it" link causes 
the execution of the transaction-wrapper that fills the correct forms in the correct order, 
ultimately bringing the user to the point where the user can confirm the transaction. All 
intermediate steps of filling forms with user-specific information is performed by the 
wrapper. 

3.4.2 Applications in Select Embodiments 

In a particular embodiment, the automated form filling technology may be 
used in a proxy server to intercept incoming pages. In an alternative embodiment, the 
automated form filling technology may be used in a browser program to screen pages 
before display to the user. 

4.0 Conclusion 

In conclusion the present invention provides for a method of automatically 
filling in forms in conducting transactions with multiple vendor sites using a common 
interface. An advantage of the present invention is that there is a single point of user 
profile information for submission. A further advantage of the present invention is that it 
enables the user to buy a collection of items by a given date at the minimum cost, 
including tax and shipping charges. A yet further advantage of the present invention is 
that it employs a single point to check out instead of multiple points thus saving time and 
money for everyone concerned. 

Other embodiments of the present invention and its individual components 
will become readily apparent to those skilled in the art from the foregoing detailed 
description. As will be realized, the invention is capable of other and different 
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embodiments, and its several details are capable of modifications in various obvious 
respects, all without departing from the spirit and the scope of the present invention. 
Accordingly, the drawings and detailed description are to be regarded as illustrative in 
nature and not as restrictive. It is therefore not intended that the invention be limited 
5 except as indicated by the appended claims. 
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1. A method of automatically filling in on-line forms in an internet 
transactional environment, said on-line forms being contained in a plurality of pages, 
presented by one or many internet sites, comprising the steps of: 

determining based upon selected criterion a form identifier corresponding to a 
particular on-line form; 

for each form identified in the determining step, identifying a plurality of 
corresponding match patterns; 

matching each match pattern identified in the identifying step to a particular page 
containing said particular on-line form; 

parsing said particular page to obtain a plurality of attributes; 

for each attribute obtained in the parsing step, indexing into a database to obtain 
user information; 

filling in said particular on-line form with said user information obtained in the 
indexing step. 

2. The method of claim 1 wherein said selected criterion further comprises a 
Uniform Resource Locator (URL). 

3. The method of claim 1 wherein said forms are presented by online sites to 
gather information to complete a transaction. 

4. The method of claim 1 further comprising the steps of: 
recognizing a subsequent form presented by said on-line site; 

performing the determining through filling steps repeatedly for said subsequent 

form. 

5. The method of claim 1 wherein said online sites are world wide web sites. 

6. A system for automatically filling in on-line forms in an internet 
transactional environment, said on-line forms being contained in a plurality of pages, 
presented by one or many internet sites, comprising: 
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5 at least one client and at least one server, said client and said server operatively 

6 disposed to: 

7 determining based upon selected criterion a form identifier corresponding 

8 to a particular on-line form; 

9 for each form identified in the determining step, identifying a plurality of 

10 corresponding match patterns; 

11 matching each match pattern identified in the identifying step to a 

12 particular page containing said particular on-line form; 

13 parsing said particular page to obtain a plurality of attributes; 

14 for each attribute obtained in the parsing step, indexing into a database to 

15 obtain user information; 

16 filling in said particular on-line form with said user information obtained 

17 in the indexing step. 

1 7, The system of claim 6 wherein said selected criterion further comprises a 

2 Uniform Resource Locator (URL). 

1 8. The system of claim 6 wherein said forms are presented by online sites to 

2 gather information to complete a transaction. 

1 9. The system of claim 6 further comprising the steps of: 

2 recognizing a subsequent form presented by said on-line site; 

3 performing the determining through filling steps repeatedly for said subsequent 

4 form. 

1 10, The system of claim 6 wherein said online sites are world wide web sites. 

1 11. A computer programming product for automatically filling in on-line forms 

2 in an internet transactional environment, said on-line forms being contained in a plurality 

3 of pages, presented by one or many internet sites, comprising: 

4 a computer readable storage medium; 

5 code for determining based upon selected criterion a form identifier corresponding 

6 to a particular on-line form; 
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code for identifying a plurality of corresponding match patterns, for each form 
identified by the determining code; 

code for matching each match pattern identified by the identifying code to a 
particular page containing said particular on-line form; 

code for parsing said particular page to obtain a plurality of attributes; 

code for indexing into a database to obtain user information, for each attribute 
obtained in the parsing step; 

code for filling in said particular on-line form with said user information obtained 
in the indexing step. 

12. The computer programming product of claim 11 wherein said selected 
criterion further comprises a Uniform Resource Locator (URL). 

13. The computer programming product of claim 11 wherein said forms are 
presented by online sites to gather information to complete a tt-ansaction. 

14. The computer programming product of claim 11 further comprising: 
code for recognizing a subsequent form presented by said on-line site; 

code for invoking the code for determining through the code for filling repeatedly 
for said subsequent form. 

15. The computer programming product of claim 11 wherein said online sites 
are world wide web sites. 



wo 99/46701 



PCT/US99/04489 




SUBSTITUTE SHEET (RULE 26) 



wo 99/46701 



PCT/US99/04489 




SUBSTITUTE SHEET (RULE 26) 



FIG. 1B 
(Prior Art) 



wo 99/46701 



PCT/US99/04489 



3/12 




User Selections 



100 



Tmnsaction Integrator 




160 



FIG. 1C 



f 

r' 



SUBSnrUTE sheet (rule 26) 



wo 99/46701 



PCT/US99/04489 



4/12 



62 



Form Name 



Form URL 



60 
J 



Form Name 



Pattern of Matching 



70 
J 



Fomi Name 



Attribute Name 



Property Name 



Transformation Function 



80 
J 



User to 



Form ID 



Propert/A^alue 1 



Property/Vatue 2 



Property/Value 2 



Property/Value N 



90 
J 



FIG. 1D 



SUBSTITUTE SHEET (RULE 26) 



wo 99/46701 



PCT/US99/04489 



5/12 



Enter a Shipping Address 



201 

J 



On the mailing label, we will use exactf^ what you enter here (except the phone number), so please make 
sure this address is the way you want it to appear. 

• Please rrote, we cannot ship Second Day or Next Day Air to the following P.O. boxes. 
APO/FPO addresses, served by the USPS, including Guam and the U.S. Virgin Islands. 

• For APO and FPO addresses, please enter APO or FPO in the City field and one of the following 
two-letter codes in the State field 



Name; 



202 



Address Line 1 (or company name): 
Addr ess Line 1 (optiona l) 
City: 



204 



206 



state: 



Zip Code: 



208 
-210 
1<-212 



Phone Number 



■214 



Click here when you are 



done 



with this address. 



216 



FIG. 2A 
(Prior Art) 



SUBSTTTUTE SHEET (RULE 26) 



wo 99/46701 



PCT/US99/04489 



6/12 



Account Establishment 



203 



Name: 




Phone: 1 | Email ArtrirA^- 




Choose a password to use with Powells. Password: 







Shipping Address: ® Residential:^ Business 



Street Address: 
Code: 



City: 



State/Province: 



Country: 



US 



Alternate Email (optional): 
Shipping (check cut our shipping rates): 



Company (optional): 



Continent 
a) United 
States 


^ UPS 
Ground 


^ UPS 
Next Day Air 


^ UPS 
2nd Day Air 


^ US Postal 
Service Bookrate 
(Uninsured) 


Intematio 
nal 


O DHL 
WoridMail 


O 

UPS Express 


^ US Postal 
Service Surface 


Alaska, 
Hawaii, 
Puerlo 
Rico 


o 

US Postal 
Service Priority 


^ UPS 
Next Day Air 


^ UPS 
2nd Day Air 


^ US Postal 
Service Bookrate 


APO/FPO 

/US 
Territories 


^ US Postal Service Priority 


^ US Postal Service Bookrate 



Type of account to establish? 
. . . ^ Business - <deleted inf ormation> 
© 



-222 



Credit Card - YOU - <deleted information> 
Credit Card: 



-224 



® Visa 


O 


Card Number 






Expiration 






Name on card 






issuing bank 











Zip Code/Postal 



220 

J 



■226 
•228 
230 
232 
234 



FIG. 2B 
(Prior Art) 



SUBSTITUTE SHEET (RULE 26) 



wo 99/46701 



PCT/US99/04489 



7/12 



in 
o 

CVJ 



o 
O 

0) 
Q) 
U) 

c 

3 

-3 



.o 



o 
CO 
CQ 



CO 

E 



(0 

o 

Oi 

'6 
P 





CO 




(i> 




CO 








13 




§. 


CO 




Fos 


o 






O 


3 




CO 




0) 


< tr 



I 



C 

.9- 1= 



o 

CVJ 



mf*^ ml ml il] ^ 



o 
m 

CO 



c 



CO O 
« CO 



O 

to 



CO 



«g CO 

I 

CO 



o 

O) 



CO 
I 

CVJ 



CO 



to 



CO 



CO 



O 



CO ^ (0 (0 CO CO 
3 ^ Q. 3 is Q. 



o 

o 

CO 
CO 

o 



CO 

a 

>> 

CD 
CO 



<D 

c 



c 

(0 



CO 



o 

CO 

oi 



(0 

a> 

Q. 
(0 



c 

CO 

a 

CD 
CO 
CO 

£ 



CO 
CO 



O .2 



O 2 



^ CO . 5 

.*= O Q, C 

0 5 2 0 5 0 2 

(U 

2 
o 

z 



C 
CO 

v> 

CD 

E 

CO 

m 



o 
B 
CO 

8 

m 



(Dt 
CO 

8 

m 



CO 

a 



CD 
CO 



m 



B 

CO 

E 

I 

Q. 
CO 

£ 
CO 

I* 

« 

> 
cd 

■D 
C 
CO 
c 
g 

E 
o 



9- 
's: 

CO 

CO 
0) 



0) 



o 
c 



CD 
O 
'C 
Q. 



CO 
Xi 
T3 
<D 
CD 



T3 
C 
(D 

CO 

c^ 

CO 

c 
o 

CO 

o 
o> 

CD 
3 
CO 

o 
c 

CD 

E 
E 

8 

0) 

c 
o 

••s 

CD 
3 

o 



o 

CM 



SUBSmrUTE sheet (rule 26) 



wo 99/46701 



PCT/US99/04489 



8/12 



o 
O 

c 

3 



.o 



o 
m 



I 



c 

5. o 



CO 

E 
a> 

c 



o 
o 



•a 

0) 



x: 

CO 
0) 
CO 



(0 



3 

£ 
o 



c 
E 



T3 

a> 
c 

T3 



C 

cd 
5 



(/) w ^ 

§ 3 05 
>= < CE 



pi 



0) 



■o 



0 


■CI 


2 




0 




0 




CO 








^ 




pp 


ol 


dd 


ol 


PP 


ol 


pp 


< 




< 




< 




< 










CO 




CO 






u 




>. 






0 




0 




Cd 




5- 






« 




T3 




T3 


c 




c 




CO 




CO 










CVl 




CVl 



0I5 
< 



CO 

o 

CM 



o 
in 

CO 



CO o 



*g CO 

I 

CO 



CO CO CO 
^ <a T3 ^ 

CO CO 



o 
in 
in 



o 

CO 

cn 



o 



-D <i> 0) 
©■go. 

CO (0 (0 

3 ^ cs. 



CO 
CO 



a 2 



b 

(D 
10 
CO 
O 



ay 



I 

CD 5 



CO 

o 
o 

CQ 



0 



o 
u. 



o 

CO 

o> 



£-8 



c 
cd 



CO 



O) 

Cd 
c 



0) 
CO 



u 
Cd 



CD c a> 0) 
:e7dT 



1 

Q- 



i 

0. 



o 
CD 

o 
Z 

■D 
C 
CD 
CO 
0) 

E 
Cd 
CD 



_ c 
(d 

si 

2 s 



I 

a 2 



m 

CD 5 



CO 

o 
eg 

CO 

s 

CQ 



<D 
CO 

o 
o 
m 



td 
E 
'x 
o 

Q. 

£ 
Cd 

jd 

> 
(d 

T3 
C 
(0 
c 
o 



o 
c 
a> 

JO 

a, 
a. 
Ic 

CO 

CO 

0) 
TD 
_3 
U 
C 

o 
c 
>* 
Cd 
E 

CO 
0) 



SUBSTITUTE SHEET (RULE 26) 



wo 99/46701 



PCT/US99/04489 



9/12 



301 



Search Web Sites for 
Items of Interest to 
User 



312 



Display Search Results 
to User with Capability 
to Make Selections 



314 



Receive from User a 
Selected Item 



h 

316 



Initiate a Transaction 
with Site Appropriate to 
User Request 
( See Rg. 3C ) 



h 

318 



End 



FIG. 3A 



SUBSTITUTE SHEET (RULE 26) 



wo 99/46701 PCTAJS99/04489 



10/12 



■303 



322 



Search Web Sites for 
Items of Interest to 
User 



r 



324 



Display Search Results 
to User with Capabiiity 
to Make Selections 



r 



325 



Add to the List of Items 
to Purchase by Clicking 
on "Add to Cart" Button 



Parse the Selection for 
326 about the 

Request 



Add Data to User 
328 Selection Database 




FIG. 3B 



SUBSTItUTE SHEET (RULE 26) 



wo 99/46701 



PCT/US99/04489 



11/12 



305 




Rd in Form with 
I nformation about iJser 
and Selections 
( See Fig. 3D ) 



-344 



Prompt User for 
ConfirmatJon to 
Complete Transaction 
(Optional) 



h 

346 



Complete Transaction 
with Vendor Web Site 



h 

348 



End 



3 



FIG. 3C 

SUBSinVTE SHEET (RUU 26) 



wo 99/46701 



PCTAJS99/04489 



12/12 



n 

359 



Identify Using 
Relationship 80 the 
Appropriate Properties 
Required to Fill In Fomi 



360 



Obtain Values for Each 
Property Using 
Reiationsliip 90 



362 



Transfonn Properties 
to Entries for Fronri 
Attributes using 
Relationship 80 



364 



Modify Page to Fill In A 
User Values for Each 
Attribute 







1 



Detemnlne Based Upon 
Criterion the 
Appropriate Order 
Entry Form Identifier 
for a Particular Vendor 
Using Relationship 60 



350 



•307 



Based Upon the Fonm 
Identifiers. Determine 

Corresponding 
Matching Patterns from 
Database Using 
Relationship 70 



w 

352 



Match the Patterns to 
the Page Containing 
the Fonn 



354 



^ Return ^ 




FIG. 3D 

SUBSTITUTE SHEET (RULE 26) 



INTERNATIONAL SEARCH REPORT 



International application No. 
PCT/US99/04489 



A. CLASSIFICATION OF SUBJECT MATTER 

IPC(6) :GC5F 17/30. 60 

US CL :70S/26; 707/507. 513 
According to International Patent Classification (IPC) or to both national classification and IPC 



FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 
U.S. : 705/26, 27, 37, 44; 707/507, 513 



Documentation searched other than minimum documentation to the extent that such documems are included in the ftelds searched 



Electronic data base consulted during the interoational search (name of dau base and, where practicable, search terms used) 
APS, NPL, USPAT. JPO. EPO. USOCR. DERWENT 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of documem, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



A.E 
A,E 

A.E 
A.E 

A,E 

A,E 

A.E 



US 5,794,259 A (KIKINIS) 11 August 1998, see entire document 

US 5,758,328 A (GIOVANNOLI) 26 May 1998, see entire 
document 

US 5,897,622 A (BLINN et al) 27 ^ril 1999, see entire document 

US 5,890,139 A (SUZUKI et al) 30 March 1999, see entire 
document 

US 5,832,459 A (CAMERON et al) 03 November 1998, see entire 
document 

US 5,794,207 A (WALKER et al) 11 August 1998, see entire 
document 

US 5.745,681 A (LEVINE et al) 28 April 1998. see entire document 



1-15 
1-15 

1-15 
1-15 

1-15 

1-15 

1-15 



ri Pmther docomeirtB are listed in the comimffltioa of Box C. See pstesct family obbssl 



SfctoX cotCQonoo of oitcd dooimouo: 

document dofinmp tho gonaml ototo of tho 011x7111^1 is notooiuidarod 
to bo of poftwulor nloTonoo 

ecu tier dootnnont p uM ichod on or oflor ttio ntomotional lUins doto 
daoBBont tThioli mcy thro^ doubts on pnsnty olaii&(B) or iTtueh t& 
BpoeiQl fessoo (as opoctiiod) 

doomcttt [ofuixiug to on orol dirckwuro, uoo, exhibition or othor 



doto ond not in 



xiiA tho lypBoatifln but citcid to 



•X* 



doennont |«"Ktw>s<wf jgiat to tho i nt^<fnn»"*TT "i pljng iloto but loior th^n 
tho pnonty date ciainiod 



docomont of parttcabr nknronoo; ttio olotncd itnrc3itio& cannot bo 
oossidciod noTol or ca nn ot bo coaoidorod to inrohro on iSTOStiTO tbop 



dodiflftottt of pQ^bonhir roJoronco^ ttto olaiQod uvondtton 
eonsiderad to involro cn inToatiTO stop wbtn the 1' 
oomfaiDod Qith oao or moro other moh dooasenta» ccsh 
boing obviouD to a panxm stdUod in tho ort 

doomnont nontbor of tho sonio potent fcnufy 



Date of the actual complecion of the intenacianal search 
10 MAY IS^ 



Date of mailing of the intenatianal search lepoit 



2 6 MAY 1999 



Name and mailmg address of the ISA/US 
Comauasioner of Pctents and Tmdomartcs 
BoePCT 

Wfl&hingtoiu D.C 20231 
Pflcsit Vo. (703) 305-3230 



Authorized officer 

JOSEPH FEILD 
TelqAone No. (707 



Form PCT/I5A/210 (second sheet)<My 1^) « 




